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ABSTRACT 


The  implementation  of  a  Naval  Supply  Systems  Command 
Quality  Control  Program  is  intended  to  promote  improved 
performance  at  U.S.  Naval  stockpoints.  This  paper  examines 
current  quality  control  procedures,  compares  current  practice 
to  quality  control  theory,  and  recommends  that  sequential 
sampling  techniques  be  adopted.  Sequential  sampling  plans 
and  their  associated  operating  characteristic  curves  and 
average  sample  number  curves  are  provided.  Implementation  of 
the  recommended  procedures  would  result  in  a  more  flexible 
and  efficient  Quality  Control  Program  at  Naval  Supply  System 
stockpoints. 
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I.  INTRODUCTION 


Quality  control  is  recognized  as  one  of  management's 
best  and  most  effective  tools  in  controlling  and/or  detecting 
causal  variation  in  a  process.  The  Naval  Supply  Systems 
Command  Headquarters,  realizing  the  merits  of  quality  control, 
instituted  a  Quality  Cor.  ;-ol  Program  for  its  stockpoints  by 
prescribing  quality  objectives  for  certain  material  flow 
functions  and  process  times . 

The  purpose  of  this  paper  is  to  examine  these  NAVSUP 
Quality  Control  procedures,  to  assess  their  validity  in  light 
of  existing  sampling  theory,  and  to  recommend,  where  appro¬ 
priate,  improvements  within  the  limits  of  available  personnel 
resources . 

The  overall  objective  is  to  provide  a  program  for  use  by 
Naval  stockpoints  that  is  both  practical  and  efficient,  and 
which  will  enable  stockpoints  to  enhance  and  improve  their 
internal  performance,  thus  resulting  in  better  service  to 
the  fleet.  Five  sampling  plans  with  their  associated  opera¬ 
ting  characteristic  (OC)  curves  and  average  sample  number  (ASN) 
curves  are  proposed  which  will  allow  a  flexible  implementa¬ 
tion  of  quality  control  programs  at  Naval  stockpoints. 

The  material  in  this  paper  is  presented  in  five  sections. 
Section  II  develops  the  background  information  necessary  for 
a  basic  understanding  of  statistical  quality  control.  Areas 
discussed  include  the  objectives  of  quality  control,  sampling 


strategy  to  be  used,  the  concepts  of  the  consumer-producer 
relationship  and  operating  characteristic  curves,  an  explana¬ 
tion  of  attributes  sampling  techniques,  and  determination  of 
an  estimate  of  and  confidence  interval  for  proportion  defec¬ 
tive.  In  addition,  there  is  a  brief  development  of  Depart¬ 
ment  of  Defense  policy  on  quality  control. 

Section  III  discusses  the  current  NAVSUP  Quality  Control 
Program  for  both  material  flow  and  process  times,  while  Sec¬ 
tion  IV  proposes  new  procedures  utilizing  sequential  analysis. 
Section  IV  also  describes  how  to  apply  a  specific  sequential 
sampling  plan  and  how  to  develop  a  complete  quality  control 
program  at  Naval  stockpoints. 

In  Section  V  a  comparison  is  made  between  the  current 
and  proposed  quality  control  programs.  Section  VI  contains 
the  conclusions  and  recommendation  of  this  paper.  Finally, 
the  actual  sampling  plans,  OC  curves,  and  ASN  curves  are  given 
in  the  Appendix. 
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II.  BACKGROUND 


A.  OBJECTIVES  OF  QUALITY  CONTROL 

The  main  objectives  of  quality  control  are  to  determine 
and  eliminate  causes  for  errors  and  to  establish  control  of 
the  quality  of  the  process  in  order  to  prevent  unsatisfactory 
output  from  that  process.  For  quality  control  purposes,  a 
process  is  defined  as  the  employment  of  materials,  equipment, 
and/or  men  for  the  purpose  of  production.  Quality  control 
is  primarily  concerned  with  determining  the  capability  of 
a  process  to  meet  established  standards. 

In  any  process  in  which  material  is  expected  to  conform 
to  an  established  standard,  variations  in  the  material  output 
from  the  process  occur.  It  is  the  objective  of  quality  con¬ 
trol  to  detect  changes  in  a  particular  process  by  observation 
of  these  variations.  If  there  is  an  unexpected  variation  in 
the  system  process  average  as  detected  by  inspection,  then 
the  variation  is  likely  due  to  presence  in  the  system  of  some 
assignable  cause,  such  as  a  change  in  personnel  or  work  method. 
Once  this  assignable  cause  is  detected,  corrective  action  can 
be  taken  to  improve  the  quality  of  the  process. 

Acceptance  sampling  is  commonly  used  in  industry  and 
government  to  discover  variations  in  material  output  from  a 
process.  Acceptance  sampling  is  concerned  with  the  accep¬ 
tance  or  rejection  of  an  entire  lot  based  on  the  results  of  a 
sample  taken  from  that  lot.  With  this  type  of  sampling,  a 


number  of  units  from  each  lot  is  inspected.  If  the  amount 
defective  is  less  than  a  prescribed  minimum,  the  lot  is  accepted; 
if  not,  the  lot  is  rejected  as  being  below  standard.  Accep¬ 
tance  sampling  can  be  performed  in  any  situation  where  there 
is  a  consumer-producer  relationship  as  described  in  Section 
II. D.  Close  adherence  to  standards  means  fewer  defects,  and 
a  savings  of  costs  which  would  otherwise  be  required  for  re¬ 
working  material  processed  incorrectly. 

Acceptance  sampling  plans  are  used  by  the  U.S.  Navy  at 
its  stockpoints  in  order  to  control  the  flow  of  requisitions 
and  material  within  the  supply  system.  A  stockpoint  is  a 
supply  center  or  depot  whose  primary  functions  include  the 
issuing,  stocking,  and  receiving  of  material.  The  operation 
of  Navy  stockpoints  is  a  highly  complex  system  from  receipt 
of  material  from  suppliers  and  receipt  of  requisitions  from 
customers,  to  the  issue  of  material  to  these  customers. 

Increased  emphasis  or  quality  assurance  throughout  each  seg¬ 
ment  of  the  operational  cycle  of  a  stockpoint  is  required  in 
order  to  provide  service  to  the  fleet  in  the  most  economical 
way  possible. 

B.  SAMPLING  INSPECTION  STRATEGY 

The  primary  objective  of  taking  samples  from  a  population 
is  to  learn  something  about  that  population  upon  which  a  deci¬ 
sion  can  be  based.  In  order  to  ensure  that  the  sample  selected 
from  a  lot  is  representative  of  the  whole  population,  it  is 
essential  that  the  sample  be  drawn  in  a  random  manner. 


10 


Randomness  implies  that  every  item  in  the  lot  has  an  equal 
chance  of  being  selected.  Because  of  the  difficulties  of 
random  selection  in  large  lots,  it  is  advisable  to  adopt 
stratified  or  proportional  sampling.  In  stratified  sampling 
the  size  of  subsamples  from  each  sublot  is  proportional  to  the 
sublot  size,  and  sampled  items  are  drawn  randomly  from  all 
parts  of  each  sublot  of  the  inspection  lot.  This  grouping 
seldom  has  a  significant  effect  on  the  theoretical  behavior 
of  the  sampling  results  as  manifested  by  the  OC  curve.  Grant 
[Ref.  1]  For  a  more  detailed  discussion  of  stratified 
sampling  see  Raj  [Ref.  2]  and  Cochran  [Ref.  31. 

Another  consideration  in  sampling  inspection  is  that  each 
lot  inspected  be  homogeneous,  that  is,  each  lot  should  repre¬ 
sent  as  nearly  as  possible  the  output  from  one  process  during 
one  interval  of  time,  so  that  all  material  in  the  let  is 
turned  out  under  essentially  the  same  conditions. 

There  are  several  advantages  to  sample  inspection  when 
compared  with  100  percent  inspection.  First,  sampling  is  more 
economical  since  there  are  fewer  items  inspected.  Second, 
there  is  less  handling  damage  during  inspection.  Third,  fewer 
inspections  are  required  which  requires  fewer  personnel.  The 
fourth  and  probably  most  significant  advantage  of  sampling 
inspection  is  that  it  creates  pressure  for  quality  improve¬ 
ment,  since  entire  lots  are  rejected  rather  than  individual 
defectives.  This  is  likely  to  result  in  the  submission  of 
better  quality  material  for  inspection. 
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C.  DOD  QUALITY  ASSURANCE  POLICY 

The  primary  implementing  directive  for  Department  of 
Defense  Quality  Assurance  Policy  is  DOD  Directive  4155.1  of 
August  10,  1978  with  Change  One  incorporated .  It  states: 

"DOD  components  will  plan  and  implement  a  quality  program  as 
an  integral  part  of  all  phases  of  the  acquisition  and  support 
process  and  will  conduct  quality  audits  to  assure  the  attain¬ 
ment  of  quality  products  and  services." 

SECNAVINST  4855.1  of  September  10,  1979  implements  DOD 
Directive  4155.1.  There  the  Chief  of  Naval  Material  is  desig¬ 
nated  to  ensure  compliance  with  the  provisions  of  DOD  Direc¬ 
tive  4155.1  and  to  develop  and  issue  supplemental  policies 
and  instructions. 

NAVMATINST  4855. lA  of  January  24,  1974  designates  systems 
commands  to  formulate  quality  assurance  programs  consistent 
with  the  quality  assurance  directives  cited  above.  In  com¬ 
pliance  with  those  directives  NAVSUP  must  provide  sampling 
plans  and  procedures  as  appropriate  to  ensure  the  adequacy 
of  inspections  at  all  stages  of  the  material  life  cycle. 

D.  CONSUMER-PRODUCER  RELATIONSHIP 

When  acceptance  sampling  is  used,  there  is  generally  a 
conflict  of  interest  between  the  consumer  who  specifies 
standards  of  conformance  and  the  producer  who  produces  the 
material  for  the  consumer.  Within  the  Naval  Supply  System, 
a  consumer-producer  relationship  exists  between  the  Naval 
Supply  Systems  Command,  which  establishes  material  flow  and 
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process  time  standards,  and  the  Naval  Supply  Center  (NSC), 
which  ensures  that  NAVSUP  standards  are  attained  throughout 
the  operational  cycle  of  receiving,  storing,  and  issuing 
material . 

The  NSC  in  effect  is  the  producer  of  a  product,  i.e., 
service  to  the  fleet.  The  NSC  samples  its  own  performance 
using  sampling  procedures  and  reports  its  findings  quarterly 
to  NAVSUP.  NAVSUP  then  acts  on  behalf  of  the  consumer  and 
decides  from  the  quarterly  reports  whether  the  NSC  product  is 
acceptable  in  meeting  NAVSUP-established  standards.  If 
prescribed  standards  are  not  met,  the  lot  (i.e.,  the  NSC's 
performance)  is  "rejected"  as  substandard.  Although  this 
rejection  is  more  figurative  than  literal,  it  carries  suffi¬ 
cient  stigma  that  such  action  should  not  be  taken  lightly. 

The  consumer  wants  a  sampling  plan  which  will  reject  lots 
with  their  percentage  defective  above  a  certain  level  called 
the  lot  tolerance  percentage  defective  (LTPD) .  LTPD  is  de¬ 
fined  in  Robertson  [Ref.  4]  as  the  incoming  fraction  defec¬ 
tive  that  the  consumer  is  willing  to  accept  with  a  very  small 
probability  of  occurrence.  The  LTPD  is  a  numerical  definition 
of  "bad"  quality  and  is  commonly  designated  by  the  symbol 
p2.  If  the  plan  accepts  too  many  lots  above  the  LTPD,  the 
quality  of  material  will  be  unsatisfactory.  The  consumer's 
risk,  designated  by  3,  is  the  probability  of  acceptance  of 
a  "bad"  lot.  p  is  commonly  chosen  as  0.10.  This  means  that 
in  the  long  run,  only  one  lot  in  ten  of  quality  p2  will  be 
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accepted.  This  is  generally  sufficient  protection  to  the 
consumer,  since  producers  cannot  afford  to  have  nine  out  of 
ten  lots  rejected,  as  would  occur  if  the  actual  quality  of 
the  material  were  as  poor  as  p2. 

The  producer  wants  a  sampling  plan  which  will  accept  lots 
of  satisfactory  quality  called  the  acceptance  quality  level 
(AQL) .  The  AQL  is  defined  as  the  maximum  percentage  of  de¬ 
fects  that  is  acceptable  as  the  process  average,  or  the  long 
run  average  quality  of  items  submitted  for  the  purpose  of 
sampling  inspection.  The  AQL  is  a  numerical  definition  of 
"good"  quality  and  is  commonly  designated  by  the  symbol  pi. 

If  lots  of  better  than  pi  quality,  i.e.,  those  with  AQL  less 
than  pi,  are  rejected,  this  means  unwarranted  rejection.  The 
producer's  risk,  designated  by  ot,  is  the  probability  of  re¬ 
jection  of  a  "good"  lot.  a  is  frequently  chosen  as  0.05. 
Since  the  probability  of  rejection  is  the  opposite  of  the 
probability  of  acceptance,  the  five  percent  rejection  level 
is  equivalent  to  an  acceptance  level  of  quality  (ALQ)  of  95 
percent  for  material  of  pi  quality,  i.e.,  five  percent  AQL 
is  the  complement  of  95  percent  ALQ. 

E.  OPERATING  CHARACTERISTIC  CURVES 

The  operating  characteristic  (OC)  curve  is  a  graph  which 
shows  producer  and  consumer  risks  in  the  use  of  a  particular 
sampling  plan.  It  shows  graphically  the  way  a  specified 
sampling  plan  operates  as  the  incoming  quality  level  of 
material  varies.  An  ideal  operating  characteristic  curve  is 


shown  in  Figure  1  for  pi  =  0.025.  All  lots  submitted  for 
inspection  with  a  proportion  defective  (p)  less  than  or  equal 
to  pi  have  a  probability  of  acceptance  (Pa)  equal  to  one,  and 
those  lots  with  proportion  defective  greater  than  pi  have 
Pa  equal  to  zero.  Probability  of  acceptance  is  plotted  on 
the  vertical  axis  and  incoming  quality  on  the  horizontal  axis 
of  the  graph.  It  is  desirable  to  have  an  OC  curve  as  near  to 
this  ideal  shape  as  possible  consistent  with  practicality  and 
economy.  Unfortunately  a  z-shaped  OC  curve  is  attainable 
only  by  perfect  100  percent  inspection. 

In  actual  practice,  the  quality  of  batches  submitted  for 
inspection  will  vary,  and  the  sampling  plan  will  reject  a 
higher  percentage  of  "bad"  quality  lots  and  accept  more  of 
the  "good"  quality  lots.  As  a  result,  sampling  inspection 
will  improve  the  overall  quality  of  material  inspected. 

Every  sampling  plan  has  a  unique  OC  curve  with  its  shape 
based  on  sample  size  (n) ,  an  acceptable  number  of  defects 
(c) ,  and  the  percentage  of  defects  in  the  lot  (p) .  Material 
containing  no  defectives  is  always  accepted  regardless  of  the 
value  of  c.  Lots  with  100  percent  defectives  are  always  re¬ 
jected.  All  OC  curves  therefore  include  the  points  (p  =  0, 

Pa  =  1)  and  (p  =  l,?a  =  0) . 

The  two  most  important  points  on  the  OC  curve  are  the 
probabilities  of  acceptance  at  pi  and  p2.  Given  these  two 
points,  (pl,l-ot)  and  (p2,t3),  a  sampling  plan  and  its  associated 


Fraction  defection,  p 


Figure  i.  Ideal  OC  Curve 
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OC  curve  can  be  determined  which  provides  the  specified 
protection  to  both  the  consumer  and  the  producer. 


F.  ACCEPTANCE  SAMPLING  BY  ATTRIBUTES 

Acceptance  sampling  is  applicable  to  environments  where 
there  is  a  consumer-producer  relationship.  Acceptance  sampling 
by  attributes  classifies  a  lot  as  conforming  or  not  conforming 
to  a  specified  standard.  An  attribute  is  a  qualitative  char¬ 
acteristic  and  grades  material  as  "good"  or  "bad"  or  nondefec¬ 
tive  or  defective. 

Duncan  [Ref.  5]  emphasizes 

that  the  purpose  of  acceptance  sampling  is  to 
determine  a  course  of  action,  not  estimate  lot 
quality.  Acceptance  sampling  prescribes  a 
procedure  that,  if  applied  to  a  series  of  lots, 
will  give  a  specified  risk  of  accepting  lots 
of  given  quality.  In  other  words,  acceptance 
sampling  yields  quality  assurance. 

Thus,  acceptance  sampling  improves  the  quality  of  material  in 

a  process  by  encouraging  "good"  quality  by  a  high  rate  of 

acceptance  and  discouraging  "bad"  quality  by  a  low  rate  of 

acceptance.  "Attributes  sampling  plans  have  the  advantage  of 

greater  simplicity,  of  being  applicable  to  either  single  or 

multiple  quality  characteristics,  and  of  requiring  no  knowledge 

about  the  distribution  of  the  continuous  measurement  of  any  of 

the  quality  characteristics"  [Ref.  6]. 

1 .  Single  Sample  Plans 

In  a  single  sampling  plan,  a  sample  is  taken  from  a 
lot  and  a  decision  to  reject  or  accept  the  lot  is  made  based 
on  the  inspection  results  of  that  sample.  More  specifically. 


a  single  sampling  procedure  can  be  described  in  most  indus¬ 
trial  applications  by  only  two  numbers:  the  sample  size  (n) 
and  the  acceptance  number  (c) .  By  taking  a  sample  of  size  n, 
and  determining  the  number  of  defectives  (d) ,  an  estimate  of 
the  quality  of  material  inspected  is  given  by  p  =  d/n.  The 
lot  is  rejected  if  p  is  greater  than  c/n.  Although  this  pro¬ 
cedure  uses  an  estimate  of  lot  quality  (p)  ,  it  is  again  empha¬ 
sized  that  the  single  sample  plan's  primary  purpose  is  to 
determine  whether  to  accept  or  to  reject  the  lot. 

As  stated  above,  by  specifying  the  points  (pl,l-a) 
and  (p2,3) ,  an  n  and  c  can  be  found  such  that  the  OC  curve 
passes  through  these  two  points.  Finding  a  single  sampling 
plan  to  pass  through  these  two  points  exactly  may  be  impossi¬ 
ble  since  both  n  and  c  must  be  integer  values.  For  pi  =  0.025, 
p2  =  0.10,  ci  =  0.05,  and  3  =  0.10,  using  Table  13.13  in  Bowker 
and  Lieberman  [Ref.  7],  a  single  sampling  plan  based  on  the 
Poisson  approximation  to  the  binomial  distribution  is  given  by 
c  =  5  and  n  =  105.  The  OC  curve  for  this  plan  is  shown  in 
Figure  2.  Military  Standard  (MILSTD)  105D  [Ref.  8]  contains 
OC  curves  for  various  single  sampling  plans.  MILSTD  105D  is 
a  combination  of  standard  military  sampling  plans  designed  to 
have  certain  characteristics,  i.e.,  specified  values  of  pi, 
p2,  a,  and  3.  It  is  indexed  by  AQLs  from  0.10  percent  to 
10  percent.  It  is  widely  used  in  industry  as  well  as  in 
government . 


Probability  of 
Acceptance,  Pa(p) 


2.  Sequential  Sample  Plans 


In  single  sampling  plans  the  number  of  items  sampled 
(n)  is  fixed  by  the  plan.  In  sequential  sampling  systems 
there  are  no  fixed  sample  sizes.  Single  items  are  inspected 
at  random  and  after  each  inspection  a  decision  is  made  to 
accept  the  lot,  to  reject  the  lot,  or  to  continue  to  inspect. 
The  primary  advantage  of  using  a  sequential  sampling  plan  is 
that  it  will  usually  result  in  a  smaller  sample  than  an 
equivalent  single  sampling  plan. 

A  sequential  sampling  plan  is  defined  by  the  producer's 
risk  (a),  the  AQL  (pi),  the  consumer's  risk  (5)  and  the 
LTPD  (p2) .  The  concept  of  a  sequential  probability  ratio 
test  (SPRT)  was  developed  by  Abraham  Wald  [Ref.  9].  A  graphi¬ 
cal  presentation  of  an  item-by-item  sequential  sampling  plan 
for  a  =  0.05,  pi  =  0.025,  3  =  0.10,  and  p2  =  0.10  is  shown  in 
Figure  3.  The  horizontal  axis  is  the  total  number  of  units 
drawn  and  the  vertical  axis  is  the  total  number  of  defectives 
drawn.  If  the  graphical  method  is  used,  cumulative  sample 
results  are  successively  plotted  on  a  sequential  sampling 
chart.  If  the  cumulative  results  are  on  or  below  the  lower 
line,  the  lot  is  accepted.  If  the  cumulative  results  are  on 
or  above  the  upper  line,  the  lot  is  rejected.  If  neither  of 
these  conditions  are  satisfied,  another  item  is  inspected. 

Using  the  requirements  given  above  for  a,  pi,  3,  and  p2 ,  the 
equations  for  the  acceptance  line  and  rejection  line  can  be 
determined  from  the  following  formulas.  Derivations  are 
given  in  Duncan  [Ref.  5]. 
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X2  =  2  +  ( .Q5)n 


3.  Sequential  Sample  Chart  for  a  =  0 
3  =  0.10,  pi  =  0.025,  p2  =  0.1 


hi  =  log  ( (1-a) /6) / [log (p2/pl)  + log  (  (1-pl) /  (1-P2 ) ] 

=  log { (1-0. 05) /0. 10) )/ [log (0.10/0. 025) 

+  log ( (l-0.025)/(l-0.10) ) ] 

=  1.55  =  intercept  for  the  acceptance  line 

h2  =  log ( ( l-£)  /  ct)  /  [ log (p2/pl)  +  log (( 1-pl )/  (l-p2 )) ] 

=  log( (1-0. 10) /0. 05) /[log (0.10/0. 025) 

+  log ( (1-0.025)/ (1-0.10) ) ] 

=  2  ~  intercept  for  the  rejection  line 

s  =  log ( (1-pl) / (l-p2) )/[log(p2/pl)  + log (  (1-pl) / (l-p2) ) ] 

=  log ((1-0. 025)/ (1-0. 10) )/[ log ( 0 . 10/0 . 025 ) 

+  log ( (1-0.025)/ (1-0.10)  )  ] 

=  0.05  =  slope  of  the  lines 

Substituting  the  values  of  hi  =  1.55,  h2  =  2,  and  s  =  0.05 
into  the  following  equations  yield: 

xl  =  (-hi)  +  s*n 

=  (-1.55)  +  0.05*n  =  number  of  defectives  for  acceptance 

x2  =  h2  +  s*n 


2  +  0. 05*n 


number  of  defectives  for  rejection 


While  the  graphical  presentation  in  Figure  3  can  be 


used  as  the  sampling  plan,  it  is  generally  more  convenient  to 
use  the  format  shown  in  Table  I.  Acceptance  numbers  (xl) 
and  rejection  numbers  (x2)  are  calculated  by  substituting 
values  of  n  into  the  equations  for  the  acceptance  and  rejection 
lines.  For  example,  the  computations  for  n  =  47  are: 


xl  =  (-1.55)  +  ( 0 . 05 ) *n 


=  (-1.55)  +  (0.05) * (47)  =  0.8 


x2  =  2  +  (0.05) *n 


=  2  +  (0.05)*  (47)  =  4.35 


Table  I 

Sequential  Sample  Plan  for  pi  =  0.025, 
p2  =  0.10,  a  =  0.05,  and  3  =  0.10 


No.  of  Units  Inspected  (n)  Acceptance  No.  (xl)  Rejection  No.  (x2) 


1 

a 

b 

3 

a 

3 

19 

a 

4 

29 

0 

4 

38 

0 

5 

47 

1 

5 

56 

1 

6 

65 

2 

6 

74 

2 

7 

84 

3 

7 

93 

3 

8 

102 

4 

8 

111 

4 

9 

120 

5 

9 

a  =  acceptance  not  possible 
b  =  rejection  not  possible 
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Since  both  xl  and  x2  must  be  integers,  the  acceptance  number 
is  the  next  integer  above  xl ,  and  the  rejection  number  is  the 
next  integer  above  x2 .  As  seen  in  Table  I  for  n  =  47,  xl  =  i, 
and  x2  =  5.  Therefore,  in  a  sample  of  47  items  if  the  number 
of  defects  is  zero  or  one,  accept  the  lot.  If  the  number  of 
defects  is  five  or  more,  reject  the  lot,  and  if  the  number 
of  defects  is  two,  three,  or  four,  then  continue  sampling. 

Theoretically,  a  sample  could  be  continued  indefinitely 
in  this  manner.  In  practice,  the  sample  size  (n)  required  to 
make  a  decision  seldom  exceeds  two  times  the  average  sample 
number  (ASN)  when  incoming  material  quality  is  equal  to  the 
AQL.  Schrock  [Ref.  10]  The  ASN  is  the  "number  of  items  that 
may  be  expected  in  the  long  run  to  be  inspected  per  lot  by 
the  sampling  plan."  Bowker  and  Lieberman  [Ref.  7]  For  prac¬ 
tical  reasons,  sampling  is  generally  terminated  at  an  arbitrary 
point  and  a  decision  is  made  whether  to  accept  or  reject  the 
lot,  or  no  decision  is  made  at  all.  If  the  lot  is  accepted 
at  that  point,  consumer's  risk  increases  slightly,  whereas, 
if  the  lot  is  rejected,  producer's  risk  increases  slightly. 

Formulas  for  the  probability  of  acceptance  (Pa)  (OC 
curve  points)  and  the  average  sample  number  (ASN)  at  five 
values  of  incoming  fraction  defective  ip)  are  as  follows: 


£ 

?a  (p) 

ASN (p) 

0 

1 

hl/s 

Pi 

1-a 

( (1-a) *hl— a*h2 ) / 

(s-ol) 

s 

h2/ (hl+h2) 

( hi *h2 ) /(s* (l-s> 

) 

p2 

3 

( ( l-£ ) *h2-S*hl) / 

(p2-s ) 

1 

0 

h2,  (i-s) 

Recall  that  s  is  the  slope  of  the  acceptance  and  rejection 
lines.  These  five  points  can  be  used  to  make  adequate 
graphs  of  0 C  curve  in  Figure  4  and  ASM  curve  in  Figure  5. 

If  more  points  are  desired  refer  co  Duncan  [Ref.  5].  From 
the  above  it  is  seen  that  ASN's  are  lowest  for  lots  consisting 
of  very  good  or  very  poor  material  and  highest  for  lots  con¬ 
sisting  of  material  of  marginal  quality. 

3 .  Comparison  of  Sequential  and  Single  Sample  Plans 

Comparisons  between  attribute  sampling  plans  are 
valid  only  when  the  plans  have  essentially  the  same  OC  curves. 
The  OC  curve  assesses  the  protection  given  to  the  producer  and 
consumer  by  the  sampling  plan.  It  is  common  to  match  OC 
curves  at  the  points  (pl,l-a)  and  (p2,3)  and  then  assume  that 
other  parts  of  the  curve  deviate  only  slightly.  Duncan  [Ref.  5] 
states:  "If  the  OC  curves  of  two  acceptance  sampling  plans 

match  reasonably  well,  their  relative  efficiency  with  respect 
to  the  amount  of  sampling  required  may  be  determined  by  com¬ 
paring  the  ASNs  at  pi,  but  comparisons  may  also  be  made  at  other 
points."  Figure  6  and  Table  II  provide  a  comparison  between 
the  item-by-item  sequential  plan  and  the  single  sample  plan. 
These  plans  coincide  exactly  at  (pl,l-a)  =  (0.025,0.95),  but 
because  of  the  requirement  for  integer  values  of  c  and  n,  do 
not  coincide  exactly  at  (p2,3).  Further  it  is  seen  that  the 
single  sample  plan  is  slightly  more  severe  on  the  producer 
at  intermediate  points. 

The  ASM  curve  gives  an  indication  of  tine  anticipated 
costs  of  inspection.  Figure  7  and  Table  II  clearly  show  that 


Table  II 


Comparison 

of  Single 

and  Sequential  Plans 

at  OC 

Curve  and 

ASN  Curve  Points 

Single 

Sequential 

Pa 

P. 

ASN (p) 

P 

ASN  (p 

0.  995 

0.015 

105 

0.012 

36 

0.990 

0.017 

105 

0.015 

38 

0.  975 

0.  021 

105 

0.020 

42 

0.  950 

0.025 

105 

0.025 

46 

0.900 

0.030 

105 

0.031 

52 

0.750 

0.040 

105 

0.043 

58 

0.500 

0.054 

105 

0.058 

58 

0.250 

0.071 

105 

0.077 

49 

0.100 

0.088 

105 

0.100 

36 

0.050 

0.100 

105 

0.117 

29 

0.025 

0.  Ill 

105 

0.135 

24 

0.010 

0.125 

105 

0.156 
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the  major  advantage  of  the  item-by-item  sequential  sampling 
plan  is  that  the  ASN  is  everywhere  significantly  smaller  than 
the  sample  size  under  a  single  sampling  plan. 

At  pi  =  0.025  the  sequential  sampling  plan  reduces 
sampling  costs  by  (1  -46/105)  cr  56  percent  as  compared  with 
single  sampling. 

Besides  the  comparisons  mentioned,  there  are  other 
factors  to  be  considered  which  influence  the  choice  of  a 
sampling  plan.  Advantages  of  single  sampling  as  compared  to 
sequential  sampling  plans  include  fixed  sample  size,  a  reason¬ 
ably  accurate  estimate  of  lot  quality,  and  a  limited  amount 
of  administration.  Advantages  of  sequential  sampling  plans 
include  reduced  sampling  costs  and  lower  ASN.  The  efficiency 
of  Sequential  Sampling  for  Attributes  is  discussed  further 
in  Hamaker  (Ref.  11]. 
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G.  ESTIMATION  OF  PROPORTION  DEFECTIVE 

As  stated  earlier  in  Section  II,  one  significant  advantage 
of  attribute  sampling  is  that  it  requires  no  knowledge  about 
the  statistical  distribution  of  continuous  measurements  of 
any  quality  characteristic.  For  instance,  in  sampling  of 
process  times  by  attributes  it  is  appropriate  to  record  a 
process  time  as  either  meeting  an  established  standard  or 
exceeding  it.  Suppose  T  is  a  process  time  and  t  is  an  estab¬ 
lished  processing  time  standard  or  limit  for  a  requisition. 

Then  the  population  of  all  requisitions  can  be  divided  into 
two  groups  on  the  basis  of  this  characteristic:  those  which 
have  requisition  process  times  that  meet  the  standard  and 
those  which  do  not. 

In  order  to  estimate  the  proportion  defective,  p,  suppose 
n  requisitions  are  sampled  from  a  process.  Let  T(l),  T(2), 

...,  T (n )  be  the  independent  process  times  for  those  n  requi¬ 
sitions.  Then  p  =  P[T(i)  > t] ,  i  =  1,  2,  . . . ,  n,  is  the  proba¬ 
bility  that  the  actual  individual  processing  time,  T(i),  is 
greater  than  the  process  time  limit,  t.  Now  let  X(i)  =1  if 
T(i)  >t  (requisition  i  exceeds  process  time  limit  (Group  a))* 
and  let  X  ( i )  =  0  if  T(i)  <t  (requisition  i  within  process  time 
limit  (Group  B)  )  .  Then  p  =  P[X(i)  =1]  =  P[T(i)  >  t]  ,  i  =  1,  2, 

...,  n.  Let  S  be  the  sum  of  the  assigned  numbers  X(i).  Note 
further  that  S  is  in  fact  the  sum  of  the  0's  and  l's  and 
can  be  interpreted  as  the  number  of  requisitions  which  exceed 
the  process  time  limit,  t,  in  a  sample  of  size  n.  X  itself 
is  distributed  binomially  and  its  mean,  X  =  S/n,  is  the  proportion 


of  the  sample  belonging  to  Group  a,  and  is  an  estimate  of 

the  proportion  defective,  p,  for  the  process.  The  sampling 

distribution  of  the  mean  from  any  population  with  finite 

variance  is  approximately  normal  for  large  sample  sizes.  The 

2 

sample  variance  of  the  sample  distribution  is  a  /n.  Formulas 

yielding  the  population  mean,  y ,  and  the  population  variance, 
2 

j  ,  for  a  population  containing  a  proportion  p  of  l's  and 

2 

a  proportion  (1-p)  of  0's  are  y  =  p  and  j  =  p*(l-p) .  It 
is  emphasized  that  for  small  n  or  for  values  of  p  <  0.1  that 
the  normal  approximation  is  an  inexact  method. 


H.  CONFIDENCE  INTERVALS  FOR  PROPORTION  DEFECTIVE 

In  Section  II. G.  it  was  shown  that  for  large  lot  sizes, 

A 

p  =  S/n  is  an  approximation  for  the  proportion  of  defective 
items,  p,  in  the  lot.  Although  managers  frequently  want  a 
single  point  estimate  for  a  lot  or  process  value,  it  is  often 
desirable  to  determine  an  interval  that  will  have  a  high 
probability  of  containing  the  population  value. 

When  the  product  of  n  and  p  is  greater  than  f ive ,  the 
100* (1-a)  percent  confidence  interval  is  given  by 

p  .  Z  ,/p.iIzEi. 

^  j/2  y  n 

where  Z^2  t*ie  a/'^  Percentage  point  obtainable  from  tables 
of  the  normal  distribution. 

When  the  product  of  n  and  p  is  less  than  five,  the  Poisson 
approximation  to  the  binomial  distribution  is  used  to  set  up 
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confidence  limits  on  p  utilizing  the  Dodge -Rome  chart  in 
Duncan  [Ref.  5].  For  example,  suppose  p  =  0.02  and  n  =  100, 
i.e.,  there  were  2  defective  items  out  of  100.  For  x  =  0.05, 
to  qet  an  upper  0.95  confidence  limit  for  p,  enter  the  Dodge- 
Romig  chart  at  the  vertical  ordinate  x/2  =  0.05/2  =  0.025, 
proceed  to  the  curve  X  =  2,  and  read  off  the  x-axis  p*n  =  3.95. 
Then  the  upper  limit  for  p  would  be  3.95/100  =  0.0395.  To 
get  the  lower  0.95  confidence  limit  for  p,  enter  the  Dodge- 
Romig  chart  at  the  vertical  ordinate  (1— i/2)  =  (1-0.05/2) 

=  0.975,  proceed  to  the  curve  X  =  1  and  read  off  the  x-axis 
p*n  =  0.24.  Then  the  lower  limit  would  be  0.24/100  =  0.0024. 
The  interval  0.0024  to  0.0395  would  thus  form  a  0.95  confi¬ 
dence  interval  for  the  value  of  p.  This  interval  has  a  proba¬ 
bility  of  0.95  of  covering  the  population  value.  Confidence 
limits  using  this  latter  method  generally  pertain  more  to 
quality  control  applications  because  of  the  desire  for  small 
proportion  defective,  p. 


III.  CURRENT  NAVSUP  QUALITY  CONTROL  PROGRAM 


The  current  Naval  Supply  Systems  Command  (NAVSUP)  Uni¬ 
form  Quality  Control  Program  is  described  in  NAVSUPINST 
5220. 11C  of  October  27,  1976,  with  changes  incorporated 
[Ref.  12].  It  contains  procedures  for  sampling  certain  supply 
functions  (material  flow)  and  performance  reporting  (process 
times) ,  with  NAVSUP-established  standards  for  acceptable 
levels  of  quality  (ALQ) ,  along  with  reporting  requirements. 

A.  CURRENT  SAMPLING  PROCEDURES  FOR  INSPECTION  OF  MATERIAL 

FLOW 

NAVSUP  directs  that  the  MILSTD  105D  be  utilized  in  sampling 
procedures  for  inspection  by  attributes.  These  procedures  are 
designed  for  the  purpose  of  monitoring  certain  supply  func¬ 
tions  to  determine  whether  material  is  being  processed  accurately 
within  the  stock  point  system.  Table  III  shows  the  specific 
supply  functions  to  be  measured  for  quality  of  performance,  the 
ALQ,  and  sampling  frequency  for  each.  Optional  supply  func¬ 
tions  are  sampled  as  personnel  resources  are  available.  Pro¬ 
cedures  specific  to  each  function  are  contained  within 
NAVSUPINST  5220. 11C. 

MILSTD  105D  sampling  procedures  for  inspection  by  attri¬ 
butes  are  summarized  in  Enclosure  (2)  Attachment  (A)  of 
NAVSUPINST  5220. HC.  This  procedure  includes  the  following 
steps : 
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Table  III 


r 


Specific  Supply  Functions  to  be  Measured  for  Quality  of  Performance 


FUNCTION 

ACCEPTABLE  LEVEL 

SAMPLING 

OF  QUALITY  (ALQ) 

FREQUENCY 

Receipts 

97.5% 

Monthly 

Issues 

97.5% 

Monthly 

Packing  for  Shipment 

99.0% 

Monthly 

Release  to  Carrier 

99.0% 

Quarterly 

Operations  Accuracy* 

97.5% 

Monthly 

Accuracy  of  Documentation* 

99.0% 

Quarterly 

Frustrated  Receipts* 

99.0% 

Quarterly 

Storage  Practices* 

95.0% 

Annually 

Storage  Shelf  Life* 

97.5% 

Annually 

Preservation  Marking* 

97.5% 

Annually 

Inventory* 

99.0% 

Quarterly 

*  Optional 

1.  The  inspector  specifies  the  ALQ  for  the  supply  function 
to  be  measured  from  Table  III. 

2.  Tables  are  entered  using  inspection  level  II  and 
single  sample  plans. 

3.  The  monthly  sample  size  is  determined  from  the 
monthly  processing  rate  for  the  supply  function 
to  be  measured. 

4.  Normal  inspection  is  used  unless  two  out  of  five 
successive  lots  are  rejected,  at  which  time  tightened 
inspection  is  introduced.  Normal  inspection  is  resumed 
when  five  consecutive  monthly  samples  meet  the  stated 
criteria.  In  the  NAVSUP  Quality  Control  Program  no 
provision  is  given  for  the  situation  where  ten  consecu¬ 
tive  lots  are  under  tightened  inspection,  or  for 
reduced  inspection. 

Table  IV  shows  the  quarterly  Quality  Control  Report  for 
Material  Flow  submitted  by  Naval  stockpoints  to  NAVSUP.  When 
sampling  frequency  is  required  monthly,  the  quarterly  report 
contains  the  cumulative  figures  for  all  three  months  in  ob¬ 
taining  the  percentage  for  quality  level  attained.  In  effect, 
what  is  reported  to  NAVSUP  is  a  point  estimate  determined  from 


the  formula: 


Table  IV 


Quality  Control  Report  for  Material  Flow 

Supply  Function 

(1)  Population  _ 

(2)  Sample  size  _ 

(3)  Prescribed  ALQ  _ 

(4)  Quality  level  attained  _ 

(5)  Percent  Variance  _ 

Quality  Level  Attained  =  Number  of  nondefectives/Sample  size 

3.  CURRENT  SAMPLING  PROCEDURES  FOR  INSPECTION  OF  PROCESS 
TIMES 

NAVSUP  currently  specifies  that  sampling  of  process  times 
occurs  over  a  minimum  two-week  period  and  further  stipulates 
that  at  least  five  subsamples  be  collected.  In  order  to 
arrive  at  an  individual  subsample  size,  the  total  sample  size 
is  determined  from  an  estimated  volume  of  transactions  pro¬ 
cessed  for  each  supply  function  to  be  analyzed.  The  table  in 
Attachment  A  to  Enclosure  3  of  NAVSUPINST  5220. 11C  is  an  ex¬ 
cerpt  of  Table  A -2  from  "Sampling  Procedures  and  Tables  for 
Inspection  by  Variables  for  Percent  Defective"  (MILSTD  414) , 
which  is  used  in  the  NAVSUP  procedure  to  determine  sample  size 
from  estimated  transaction  volumes.  3v  using  this  table,  it 
is  assumed  that  the  process  times  for  each  supply  function 
are  independent  identically  distributed  normal  random  varia¬ 
bles.  Once  the  sample  size  is  determined,  items  are  sampled 
randomly  ^except  where  100  percent  inspection  is  performed: 
and  statistics  are  computed  on  the  data  collected. 
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Process  times  for  requisition  input  waiting  time,  storage 


site  processing,  transportation  hold,  and  referral  lag  time 
are  sampled  for  issue  priority  groups  I,  II,  and  III.  The 
statistical  information  provided  by  stockpoints  in  the  quar¬ 
terly  Quality  Control  Report  to  NAVSUP  is  contained  in  Table 
V.  Different  percentiles  in  the  table  are  applicable  for 
different  supply  functions. 

Table  V 

Quality  Control  Report  of  Process  Times 
IPG  I  IPG  II  IPG  III 

POPULATION 

TOTAL  SAMPLE  SIZE 

MEAN 

STANDARD  DEVIATION 
___  PERCENTILE 
NAVSUP  STANDARD 

The  95th  percentile  is  computed  for  requisition  input 
waiting  time,  the  92nd  percentile  is  computed  for  storage 
site  processing,  and  the  80th  percentile  is  computed  for 
transportation  hold.  NAVSUP-established  standards  vary 
according  to  issue  priority  group  being  sampled. 

The  95th  percentile  is  defined  as  the  value  below  which 
95  percent  of  the  distribution  of  values  fall.  The  percentile 
is  obtained  by  ordering  the  sampled  data  and  finding  the  value 
in  the  ordered  list  where  95  percent  of  the  items  in  the 
ordered  list  fail  below  that  value.  Without  the  aid  of  a 


computing  device,  the  ordering  of  data  for  large  sample  sizes 
is  error-prone  and  time-consuming. 


If  the  95th  percentile  for  a  specific  supply  function 
reported  exceeds  the  NAVSUP-established  standard,  that 
information  is  highlighted  at  NAVSUP  Headquarters,  and  stock- 
point  activities  are  required  to  submit  documentation  ex¬ 
plaining  the  reasons  for  and  planned  management  actions  to 
resolve  discrepant  areas. 
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IV.  PROPOSED  NAVSUP  QUALITY  CONTROL  PROGRAM 

A  proposed  revision  of  the  NAVSUP  Quality  Control  Program 
is  described  below.  It  contains  sequential  analysis  tech¬ 
niques  described  above  in  Section  II. F. 2.  for  sampling  certain 
supply  functions  (material  flow)  and  performance  reporting 
(process  times) .  It  also  specifies  standards  for  acceptable 
levels  of  quality  and  the  reporting  requirements. 

A.  PROPOSED  SAMPLING  PROCEDURES  FOR  INSPECTION  OF  MATERIAL 

FLOW 

Sequential  sampling  plans  for  AQL's  of  0.01,  0.025,  0.05, 
0.08,  and  0.2  are  described  in  Appendix  A.  Whereas  it  is 
straightforward  to  develop  sequential  sampling  plans  for  other 
AQL's  by  using  the  formulas  given  in  Section  II. F.  2.,  the 
actual  plans  were  generated  by  using  the  TI-59  programmable 
calculator.  Lindsay  [Ref.  13]  In  addition  to  the  plans  them¬ 
selves,  the  associated  OC  and  ASN  curve  points  are  given  in 
tabular  and  graphical  form.  Because  of  reduced  sample  sizes 
under  the  item-bv-item  sequential  plans,  it  may  be  possible 
to  sample  all  the  supply  functions  including  the  optional 
functions  listed  in  Table  III.  The  actual  number  of  times 
each  function  is  to  be  sampled  varies  according  to  personnel 
resource  availability. 

The  item-by-item  sequential  sampling  procedure  includes 
the  following  steps: 
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1.  The  ALQ  for  the  supply  function  to  be  measured  is 


specified  in  advance  from  Table  III. 

2.  Items  are  sampled  one  by  one  and  the  results  are 
recorded  serially  until  a  decision  to  accept  or  reject  is 
possible,  or  until  the  sample  termination  point  is  reached 
and  no  decision  to  accept  or  reject  has  been  made  to  that 
point.  In  practice,  the  inspector  may  sample  several  items 
in  groups  and  base  a  decision  on  whether  to  accept,  reject, 
or  continue  sampling  at  group  intervals.  According  to  Duncan 
[Ref.  5]  the  group  method  has  minimal  effect  on  the  OC  and 
ASN  curves,  but  practical  considerations  may  make  this  aoproach 
preferable  to  item-by-item  sequential  sampling.  It  may  be 
convenient  to  determine  group  size  based  on  the  number  of 
items  sampled  for  a  particular  supply  function  during  half¬ 
day  intervals. 

Under  the  proposed  quality  control  program,  quarterly  re¬ 
ports  to  N A VS UP  include  the  information  shown  in  Table  VI. 

When  a  decision  to  accept,  reject,  or  terminate  sampling  is 
made  for  a  particular  supply  function,  the  column  entries  can 
be  recorded  in  Table  VI,  indicating  sampling  is  terminated. 

The  decision  to  accept,  reject,  or  terminate  based  on  no 
decision  is  analogous  to  the  green,  red,  and  yellow  "ball" 
approach  currently  briefed  at  NAVSUP  Quality  Control  meetings. 
The  "yellow  ball",  or  termination  of  sampling  with  no  decision 
indicates  marginal  quality  for  that  particular  supply  function 
process.  Cnee  a  sample  is  concluded  for  a  particular  supply 
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Table  VI 


Proposed  Quality  Control  Report  for  Material  Flew 

Supply  function: 

Prescribed  ALQ : 

No.  of  Times  Function  Sampled 
1  2  3  4  5  6 

Sample  size 
No.  of  Defects 
Decision* 

*  A  =  Accept,  R  =  Reject,  N  =  No  Decision. 

function,  the  inspector  is  then  available  to  sample  other 
areas  or  to  initiate  a  new  sample  on  the  function  just 
concluded . 

3.  PROPOSED  SAMPLING  PROCEDURES  FOR  INSPECTION  OF  PROCESS 
TIMES 

As  mentioned  above  sequential  sampling  plans  for  various 
AQL’s  are  described  in  Appendix  A.  These  AQL  values  are  con¬ 
sistent  with  AQL's  currently  prescribed  by  NAVSUP .  Along  with 
the  plan  itself,  the  OC  and  ASN  curve  points  are  given  in 
tabular  and  graphical  form.  The  same  procedure  as  outlined 
in  Section  IV. A. ,  applies.  The  theoretical  basis  for  this 
approach  was  developed  in  Section  II. G.  Quarterly  reports  to 
NAVSUP  would  contain  the  information  shown  in  Table  VII. 

C.  APPLYING  A  SPECIFIC  SEQUENTIAL  SAMPLING  PLAN 

This  section  illustrates  specifically  hew  a  stoexpemt 
would  sample  a  particular  supply  function.  Suppose  the 
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Table  VII 


Proposed  Quality  Control  Report  of  Process  Times 

IPG  I  IPG  II  IPG  III 

POPULATION 
TOTAL  SAMPLE  SIZE 
NR.  WITHIN  STANDARD 
MEAN 

STANDARD  DEVIATION 
DECISION  * 

PRESCRIBED  ALQ 

*  A  =  Accept,  R  =  Reject,  N  =  No  Decision 

quality  control  director  at  NSC  Charleston  desires  that  a 
sample  be  conducted  on  requisition  input  wait  time  for  issue 
priority  group  (IPG)  II.  In  this  case  the  NAVSUP-established 
standard  is  that  95  percent  of  the  requisitions  received  be 
entered  into  the  computer  within  12  hours.  This  translates 
to  an  AQL  or  pi  =  0.05.  Therefore,  the  sampling  plan  in 
Appendix  A  part  III  is  used.  The  inspector  is  asked  one  after¬ 
noon  to  sample  requisitions  one-by-one  and  to  record  whether 
or  not  the  requisition  processing  standard  was  met  for  each 
in  the  sequence  sampled.  At  the  end  of  the  afternoon  the 
inspector  returns  to  his  director  with  the  results.  The 
inspector  has  sampled  50  items  and  found  two  defectives  in 
that  sample.  The  director  refers  to  Appendix  A  part  III  and 
finds  that  he  is  unable  to  accept  or  reject  the  process  based 
on  the  sample  so  far.  He  instructs  the  inspector  to  sample 
additional  items  the  next  morning.  At  neon  the  next  day  the 
inspector  returns  again  with  another  50  items  sampled  and  two 
defectives.  The  cumulative  results  show  a  total  of  100  items 


sampled  with  four  defectives.  Reference  to  Appendix  A  part 
III  indicates  that  the  process  for  requisition  input  wait 
time  for  IPG  II  material  is  under  control  and  the  decision 
to  accept  is  made. 

Reference  to  Appendix  A  part  III.B.,  shows  that  if  the 
true  process  average  is  0.95,  i.e.,  a  fraction  defective 
p  =  0.05,  then  95  percent  of  the  time  the  process  for  IPG 
II  requisition  input  wait  time  will  be  accepted  as  under  con¬ 
trol  based  on  the  sample  result.  The  average  sample  number 
(ASN)  is  120;  however,  based  on  our  sample  results  we  were 
able  to  arrive  at  a  decision  earlier,  i.e.,  after  sampling 
only  100  items  in  our  example. 

At  this  point,  the  NSC  Charleston  director  is  free  to 
initiate  a  new  sample. 

D.  DEVELOPING  A  COMPLETE  QUALITY  CONTROL  PROGRAM 

This  section  outlines  an  approach  to  be  used  in  estab¬ 
lishing  a  complete  quality  control  program  at  stockpoints. 
Utilizing  sequential  analysis  all  supply  functions  for  material 
flow  and  process  times  could  most  likely  be  sampled  within  a 
quarterly  reporting  period  due  to  the  smaller  sample  sizes 
required  in  each  functional  area. 

First,  for  each  quarterly  reporting  period  the  stockpoint 
must  designate  all  functional  areas  to  be  sampled  along  with 
their  corresponding  AQL.  The  NAVSUP-established  AQL's  currently 
prescribed  can  be  used. 


Second,  determine  from  Appendix  A  the  average  sample  num¬ 
ber  for  the  given  ALQ  for  each  supply  functional  area  to  be 
sampled  during  the  quarter.  If  a  supply  function  is  to  be 
sampled  monthly,  the  ASN  is  multiplied  by  three  to  estimate 
the  total  number  of  items  to  be  sampled  in  that  area  for  the 
quarter . 

Third,  add  the  ASN's  to  arrive  at  a  total  number  of  items 
to  be  sampled  for  the  quarter.  Note  that  this  total  number 
is  only  a  planning  figure  to  be  used  in  establishing  workload 
volume . 

Fourth,  divide  the  total  number  of  items  to  be  sampled  for 
the  quarter  by  the  number  of  workdays  in  the  quarter  to  com¬ 
pute  an  estimate  of  the  number  of  items  to  be  sampled  daily. 

Fifth,  the  director  assigns  inspectors  to  sample  supply 
functional  areas  as  discussed  in  Section  IV. C.,  above. 

This  outline  meets  the  minimum  requirements  as  contained 
in  the  current  NAVSUP  Quality  Control  Program.  However,  it 
allows  the  option  to  include  as  mandatory  all  supply  functional 
areas  considered  optional  under  the  existing  instruction.  The 
quality  control  director  may  find  that  he  wishes  to  inspect 
certain  areas  more  than  others.  The  sequential  analysis 
approach  enables  him  the  flexibility  to  increase  sampling 
in  potentially  troublesome  areas. 
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V .  COMPARISON  OF  CURRENT  AND  PROPOSED  QUALITY  CONTROL  PROGRAMS 

This  section  compares  the  current  NAVSUP  Quality  Control 
Program  discussed  in  Section  III  with  the  proposed  program 
in  Section  IV. 

A.  MATERIAL  FLOW 

A  general  comparison  of  single  and  sequential  sampling 
plans  was  made  in  Section  II.F.3.  There  it  was  seen  that  the 
major  difference  is  that  a  sequential  sampling  plan  results 
in  smaller  sample  sizes  on  the  average  while  maintaining 
protection  for  both  the  consumer  and  producer  equivalent  to 
that  of  a  single  sampling  plan. 

Under  the  existing  NAVSUP  program,  it  was  seen  in  Section 
III  that  the  only  management  information  received  by  NAVSUP 
from  the  stockpoints  is  the  quality  level  attained  for  each 
supply  function  sampled. 

Under  the  existing  NAVSUP  program,  the  stockpoint  has 
only  a  50  percent  chance  of  meeting  the  established  standard 
if  the  true  process  average  is  equal  to  the  ALQ .  That  is, 
when  taking  a  random  sample  from  a  normal  or  other  symmetric 
population,  the  probability  that  the  sample  mean  exceeds  the 
process  average  is  0.5.  This  is  clearly  an  unacceptable  risk 
for  the  producer  (stockpoint) .  Under  the  proposed  procedure 
the  producer's  risk  can  be  specified  so  that  the  stockpoint 
will  have  a  95  percent  chance  of  meeting  the  prescribed  ALQ 
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if  the  process  is  under  control.  Conversely,  the  stockpoint 
will  have  a  worse  chance  of  meeting  the  standard  if  material 
is  of  poorer  than  established  ALQ  quality.  Thus  the  consumer 
can  be  reasonably  assured  that  the  material  he  accepts  is  of 
good  quality. 

Another  feature  of  sequential  sampling  is  that  estimates 
of  lot  sizes  are  not  required  to  execute  the  plan  as  they  are 
for  single  sampling  plans.  An  example  was  taken  from  one  of 
the  quarterly  reports  to  NAVSUP  to  illustrate  the  number  of 
items  that  would  be  sampled  monthly  for  receipts  both  under 
the  current  NAVSUP  procedure  and  the  proposed  sequential  analy¬ 
sis.  For  a  population  of  32,000  items,  MILSTD  105D  requires 
that  315  items  be  sampled.  For  the  same  AQL  or  pi  =  0.025, 
the  average  sample  size  using  sequential  analysis  is  46.  Thus 
sampling  costs  are  reduced  monthly  for  receipts  sampling  by 
(1-46/315)  =  85  percent. 

The  reduced  sampling  required  by  the  sequential  plan, 
while  maintaining  producer  and  consumer  protection,  enables 
limited  personnel  resources  to  be  managed  more  effectively. 

The  flexibility  of  selecting  any  or  all  supply  functions  to 
be  sampled  in  Table  III,  along  with  the  frequency  of  sampling 
in  each  supply  functional  area,  gives  management  the  oppor¬ 
tunity  on  a  regular  basis  to  ensure  that  the  overall  supply 
process  is  functioning  according  to  established  standards. 

To  look  at  an  aggregate  comparison,  Table  VIII  lists  all 
possible  categories  to  be  inspected  along  with  their  AQL  and 
gives  the  total  number  of  items  that  on  the  average  would  be 


Table  VIII 


Aggregate  Comparison 

Supply  Function 

of  Sample 

F 

Sizes  for  Supply  Functions 

MILSTD  105D  Sequential 

Sanple  Size  ASN(p) 

Receipts 

0.025 

500 

46 

Issues 

0.025 

800 

46 

Packing  for  Shipment 

0.010 

500 

28 

Release  to  Carrier 

0.010 

315 

28 

Tailgate  Data  Analysis 

0.010 

315 

28 

Requisition  I/P  Walt  Time 

IPG  I 

0.050 

315 

120 

IPG  II 

0.050 

500 

120 

IPG  III 

0.050 

500 

120 

Referral  Lag  Time 

IPG  I 

0..080 

315 

89 

IPG  II 

0.080 

315 

89 

IPG  III 

0.080 

500 

39 

Storage  Site  Processing 

A-4 ,  A-5 

IPG  I 

0.080 

20 

89 

IPG  II 

0.080 

80 

39 

IPG  III 

0.080 

80 

89 

AD 

IPG  I 

0.080 

80 

89 

IPG  II 

0.080 

125 

89 

IPG  III 

0.080 

200 

89 

Transportation  Hold 

Lcl  Dlvy 

IPG  I 

0.200 

125 

78 

IPG  II 

0.200 

200 

78 

IPG  III 

0.200 

200 

78 

Surface 

IPG  I 

0.200 

2 

78 

IPG  II 

0.200 

125 

78 

IPG  III 

0.200 

200 

78 

Air 

IPG  I 

0.200 

80 

78 

IPG  II 

0.200 

80 

78 

IPG  III 

0.200 

50 

78 

.Mail 

IPG  I 

0.200 

80 

78 

IPG  II 

0.2C0 

125 

78 

IPG  III 

0.200 

200 

78 

Land 

IPG  I 

0.200 

50 

78 

IPG  II 

0.200 

80 

78 

IPG  III 

0.200 

125 

78 

Ops  Accuracy 

0.025 

315 

46 

Accuracy  of  Dccumentaicr. 

0.010 

315 

28 

Table  VIII  (Cont.) 


Supply  Function 

Frustrated  Receipts 
Storage  Practices 
Storage  Shelf  Life 
Preservation  Marking 
Inventory 

Totals 


MILSTD  105D 

Sequential 

p 

Sarrple  Size 

ASN(p) 

0.010 

N/A 

28 

0.050 

N/A 

120 

0.025 

N/A 

46 

0.025 

N/A 

46 

0.010 

80 

28 

7,892  2,849 
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inspected  under  the  current  NAVSUP  procedure  and  under  the 
proposed  sequential  plan.  If  each  supply  functional  area 
were  sampled  one  time  only  the  sum  of  the  ASN's  under  the 
sequential  plan  totals  2349  items.  Utilizing  quarterly  reports 
submitted  by  stockpoints  to  determine  populations  for  each 
category  in  order  to  determine  sample  size  from  MILSTD  105D, 
if  each  supply  functional  area  were  sampled  one  time  only, 
the  number  of  items  sampled  under  the  current  NAVSUP  instruc¬ 
tion  would  total  7,892,  nearly  three  times  as  many  items. 

That  is  even  excluding  several  optional  categories  where 
data  was  not  obtainable . 

In  summary,  the  proposed  sequential  sampling  plan  gives 
better  protection  for  both  producer  and  consumer,  reduces 
sample  size,  frees  limited  resources  and/or  increases  the  num¬ 
ber  and  frequency  of  supply  functional  areas  to  be  inspected, 
and  allows  more  management  information  on  process  control 
then  does  the  current  NAVSUP  Quality  Control  Program. 

B.  PROCESS  TIMES 

It  is  true  that  variables  sampling  techniques  have  smaller 
ASN  values  than  do  equivalent  sequential  sampling  plans.  How¬ 
ever,  the  theory  behind  the  development  of  variables  sampling 
plans,  including  OC  curves,  assumes  that  measurement  of  pro¬ 
cess  times  for  each  supply  function  sampled  are  independent 
identically  distributed  normal  random  variables.  There  is 
insufficient  justification  from  empirical  data  to  establish 
that  process  times  are  normal  random  variables.  In  fact, 
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simple  histograms  of  process  time  data  show  a  distribution 
that  is  highly  positively  skewed  and  distinctly  non-normal. 

Since  this  assumption  is  not  Justified,  the  sample  sizes 
obtained  from  MILSTD  414  are  too  small  to  afford  sufficient 
protection  to  the  consumer. 

The  current  NAVSUP  instruction  requires  that  the  sample 
value  at  a  given  percentile  be  less  than  a  given  standard. 

For  example,  the  92nd  percentile  value  of  a  sample  distribution 
is  required  to  be  less  than  or  equal  to  an  established  standard 
of  12  hours  for  all  referrals.  Alternatively,  sequential 
analysis  cam  be  performed  with  pi  =  0.08,  p2  =  0.15,  i  =  0.05, 
and  3  =  0.10.  This  approach  is  equivalent  to  the  current  plan 
only  in  that  it  allows  for  the  same  fraction  defective,  0.08; 
however,  it  does  not  assume  anything  about  the  statistical 
distribution  of  process  times,  nor  does  it  require  ordering 
of  large  volumes  of  data  as  does  the  current  plan. 

To  illustrate  this  point,  an  example  was  selected  randomly 
from  quarterly  reports  submitted  to  NAVSUP.  In  this  example 
the  NAVSUP  standard  was  that  92  percent  of  the  items  were  to 
be  processed  within  three  days.  This  equates  to  an  allowable 
fraction  defective  of  pi  =  0.08.  Using  the  current  variables 
sampling  approach  for  determining  sample  sizes,  MILSTD  414 
yields  a  sample  size  for  this  example  of  75  items.  It  will 
be  shown  that  the  OC  curve  for  the  single  sample  plan  c  =  10 
and  n  =  77  derived  from  Table  13.13  of  [Ref.  7]  gives  inadequate 
protection  to  the  consumer  in  this  example.  This  single  sample 
pian  yields  values  of  pi  =  0.08,  p2  =  0.2,  t  =  0.05,  and  :  =  0.10. 
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Table  IX 


A  comparison  of  the  OC  curve  for  these  values  is  made  with 
OC  curves  for  the  equivalent  single  and  proposed  sequential 
plans  for  a  =  0.05,  3  =  0.10,  pi  =  0.08,  and  p2  =  0.15  in 


Table  IX  and  Figure  8.  It  is  readily  seen  that  the  OC  curve 
points  for  the  single  plan  c  =  10  and  n  =  77  are  far  less 
stringent  on  the  producer  and  this  single  sample  plan  does 
not  provide  adequate  protection  to  the  consumer.  For  a  given 
probability  of  acceptance.  Pa,  the  fraction  defective,  p,  is 
significantly  greater  for  the  single  sample  plan  c  =  10  and 
n  =  77  as  compared  with  the  single  sampling  plan  c  =  22  and 
n  =  197  or  the  sequential  plan. 
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VI.  CONCLUSIONS  AND  RECOMMENDATION 


Several  conclusions  have  been  reached  as  a  result  of 
reviewing  the  current  NAVSUP  Quality  Control  Program  and 
the  existing  theory  on  quality  control: 

First,  currently  any  stockpoint  sample  of  material  flow 
has  only  a  50  percent  chance  of  meeting  prescribed  NAVSUP 
standards  if  the  process  average  is  equal  to  the  ALQ .  A 
properly  implemented  attributes  sampling  plan  specifying  pi, 
p2,  a,  and  5,  rewards  good  performance  by  the  stockpoint  with 
a  high  probability  of  acceptance  and  penalizes  poor  performance 
by  the  stockpoint  with  a  low  probability  of  acceptance.  The 
attributes  sampling  plan  then  provides  protection  to  both 
the  consumer  (NAVSUP)  and  the  producer  (stockpoint) . 

Second,  under  the  current  system  transaction  volumes  are 
estimated  before  a  sample  size  can  be  determined.  MILSTD 
105D  is  used  only  to  determine  sample  size  in  the  NAVSUP  pro¬ 
cedure,  and  is  not  used  for  the  purpose  for  which  it  was  de¬ 
signed,  i.e.,  to  determine  a  complete  sampling  plan  scheme. 

Third,  MILSTD  414  is  inappropriate  for  use  in  sampling 
process  times  because  they  are  not  normal  random  variables. 

Fourth,  no  attributes  sampling  plan  with  the  same  two 
points  on  the  OC  curve  can  have  a  smaller  ASN  at  those  points 
than  a  sequential  sampling  plan.  Attributes  sampling  plans 
require  no  assumption  about  the  distribution  of  the  population. 
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In  light  of  the  conclusions  reached  above,  it  is  recommended 
that  NAVSUP  adopt  a  Quality  Control  Program  utilizing  sequen¬ 
tial  sampling  techniques  for  both  material  flow  and  process 
times.  The  sequential  sampling  approach  proposed  here  enables 
all  current  and/or  additional  supply  areas  to  be  inspected 
on  a  recurring  basis  even  with  current  limited  personnel 
resources,  affords  greater  protection  to  both  the  stockpoint 
and  NAVSUP,  eliminates  the  requirement  to  estimate  transac¬ 
tion  volumes  to  determine  sample  sizes,  eliminates  the  need 
for  manual  ordering  of  large  volumes  of  data  in  order  to 
determine  values  at  various  percentiles,  and  requires  no 
assumption  about  the  statistical  distribution  of  the  data 
being  sampled. 


APPENDIX  A 


I.  Sequential  Sample  Plan  for  pi  =  0.01,  p2  =  0.10,  x  =  0.05, 
1  =  0.10,  hi  =  .939,  h2  =  1.205,  and  s  =  0.03975.  ^ ALQ  =  99%) 


A.  SAMPLE  PLAN 

No.  of  Units  Inspected  (n)*  Acceptance  No.  Re  -  iction  No. 


1 

a 

o 

2 

a 

2 

20 

a 

3 

24 

0 

3 

4  6 

0 

4 

49 

1 

4 

71 

1 

5 

74 

2 

5 

96 

2 

6 

100 

-> 

J 

6 

a  =  acceptance  not  possible 
b  =  rejection  not  possible 

*  If  there  is  no  entry  for  the  number  of  items  sampled 
(n) ,  refer  to  the  table  entry  less  than  the  actual 
number  sampled.  Sample  Procedure:  Sample  item-bv- 
item  until  criteria  are  met  for  acceptance  or 
rejection,  or  discontinue  sampling  at  termination 
point  =  56  with  no  decision. 


3.  OC  and  ASN  Curve  Points 


FRACTION  DEFECTIVE  (p) 

? (ACCEPT ,p) 

ASN  (p) 

0.002 

0.997 

25 

0.004 

0.987 

26 

0.010 

0.950 

28 

0.018 

0.363 

31 

0.035 

0.624 

31 

0.045 

0.499 

29 

0.073 

0.224 

22 

0.100 

0.100 

17 

0.129 

0.042 

13 

0.175 

0.011 

9 

II.  Sequential  Sample  Plan  for  pi 


0.025,  p2  =  0.10, 


i  =  0.05,  2  =  0.10,  hi  =  1.535,  h2  =  1.971,  and  s  =  0.0549. 
(A LQ  =  97.54) 


A.  SAMPLE  PLAN 


No.  of  Units  Inspects  (n)*  Acceptance  No.  Rejection  No, 


1 

3 

19 

29 

38 

47 

56 

65 

74 

84 

93 

102 

111 

120 

129 

139 


a 

a 

a 

0 

0 

1 

1 

2 

2 

3 

3 

4 

4 

5 

5 

6 


b 

3 

4 

4 

5 

5 

6 
6 


8 

8 

9 

9 

10 

10 


a  =  acceptance  not  possible 
b  =  rejection  not  possible 

*  If  there  is  no  entry  for  the  number  of  items  sampled 
(n) ,  refer  to  the  table  entry  less  than  the  actual 
number  sampled.  Sample  Procedure:  Sample  item-bv- 
item  until  criteria  are  met  for  acceptance  or  rejection, 
or  discontinue  sampling  at  termination  point  =93  with 
no  decision. 


B.  OC  and  ASN  Curve  Points 


FRACTION  DEFECTIVE  (p) 

0.010 

0.016 

0.025 

0.035 

0.051 

0.059 

0.080 

0.100 

0.122 

0.145 


? (ACCEPT  p) 

ASN  (p) 

0 .997 

35 

0.987 

39 

0.950 

46 

0.363 

5  4 

0 . 624 

59 

0.499 

58 

0.224 

47 

0 . 100 

36 

0.042 

23 

0.017 

3  3 


III.  Sequential  Sample  Plan  for  pi  =  0.05, 
a  =  0.05,  3  =  0.10,  hi  =  3.013,  h2  =  3.868, 
(ALQ  =  95%) 


p2  =  0.10, 

and  s  =  0.072. 


A.  SAMPLE  PLAN 

No.  of  Units  Inspected  (n)*  Acceptance  No.  Rejection  No. 


1 

a 

b 

5 

a 

5 

16 

a 

6 

30 

a 

7 

42 

0 

7 

44 

0 

8 

56 

1 

8 

58 

1 

9 

70 

2 

9 

71 

2 

10 

84 

3 

10 

85 

3 

11 

97 

4 

11 

99 

4 

12 

111 

5 

12 

113 

5 

13 

125 

6 

13 

127 

6 

14 

139 

7 

14 

141 

7 

15 

153 

8 

15 

154 

8 

16 

167 

9 

16 

168 

9 

17 

180 

10 

17 

182 

10 

18 

194 

11 

18 

196 

11 

19 

208 

12 

19 

210 

12 

20 

a  =  acceptance  not  possible 
b  *  rejection  not  possible 

*  If  there  is  no  entry  for  the  number  of  items  sampled 
(n) ,  refer  to  the  table  entry  less  than  the  actual 
number  sampled.  Sample  Procedure:  Sample  item-by¬ 
item  until  criteria  are  met  for  acceptance  or 
rejection,  or  discontinue  sampling  at  termination 
point  =  180  with  no  decision. 


B.  OC  and  ASN  Curve  Points 


FRACTION  DEFECTIVE 


P  (ACCEPT'] 


ASN (d ) 


0.030 

0.997 

77 

0.040 

0.991 

89 

0.050 

0.950 

120 

0.058 

0.863 

148 

0.068 

0.683 

171 

0.078 

0.436 

170 

0.088 

0.224 

146 

0.100 

0.100 

116 

0.119 

0.027 

80 

0.132 

0.011 

64 
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IV.  Sequential  Sample  Plan  for  pi  =  0.08,  p2  =  0.15,  a 


0.05 


3  =  0.10,  hi  =  3.181,  h2  =  4.084,  and  s  =  0.112.  (ALQ  =  92%) 

A.  SAMPLE  PLAN 

No.  of  Units  Inspected  (n) *  Acceptance  No.  Rejection  No. 


1 

a 

b 

5 

a 

5 

9 

a 

6 

18 

a 

7 

27 

a 

8 

29 

0 

8 

36 

0 

9 

38 

1 

9 

44 

1 

10 

47 

2 

10 

53 

2 

11 

56 

3 

11 

62 

3 

12 

65 

4 

12 

71 

4 

13 

74 

5 

13 

80 

5 

14 

83 

6 

14 

89 

6 

15 

92 

7 

15 

98 

7 

16 

100 

8 

16 

107 

8 

17 

109 

9 

17 

116 

9 

18 

118 

10 

18 

125 

10 

19 

127 

11 

19 

134 

11 

20 

136 

12 

20 

143 

12 

21 

145 

13 

21 
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13 

22 

154 

14 

22 

161 

14 

23 

163 

15 

23 

170 

15 

24 

172 

16 

24 

179 

16 

25 

181 

17 

25 

a  =  acceptance  not  possible 
b  =  rejection  not  possible 
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*  If  there  is  no  entry  for  the  number  of  items  sampled 
(n) ,  refer  to  the  table  entry  less  than  the  actual 
number  sampled.  Sample  Procedure:  Sample  item-by¬ 
item  until  criteria  are  met  for  acceptance  or  rejec¬ 
tion,  or  discontinue  sampling  at  termination  point 
=  180  with  no  decision. 


B.  OC  and  ASN  Curve  Points 


FRACTION  DEFECTIVE  (p) 

F  (ACCEPT  p) 

ASN 

0.055 

0.997 

56 

0.064 

0.991 

66 

0.080 

0.950 

89 

0.092 

0.863 

110 

0.105 

0.683 

128 

0.119 

0.436 

129 

0.134 

0.224 

111 

0.150 

0.100 

88 

0.176 

0.027 

62 

0.193 

0.011 
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Averaye  Sanple 
NunLer  ASN(p) 


Graphs  of  OC  and  ASN  Curves 


Fraction  defective,  p  0.15 
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V.  Sequential  Sample  Plan  for  pi  =  0.2,  p2  =  0.3,  a  =  0.05, 
d  =  0.10,  hi  =  4.176,  h2  =  5.236,  and  s  =  0.247.  (ALQ  =  80% 


A.  SAMPLE  PLAN 
No.  of  Units  Inspected  (n)* 
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15 
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21 

23 

25 

27 

29 

31 

34 

35 

38 

39 

42 

43 

46 

47 
50 
52 
54 
56 
58 
60 
62 
64 
66 
68 
70 
72 
74 
76 
78 
80 
82 
84 
86 
88 
90 
92 
94 
96 


Acceptance  No.  Rejection 
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a 

9 

a 
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0 

11 

1 

11 

1 

12 

2 

12 

2 

13 

3 

13 

3 

14 

4 

14 

4 

15 

5 

15 

5 

16 

6 

16 

6 

17 

7 

17 

7 

18 

3 

18 

8 

19 

9 

19 

9 

20 

10 

20 

10 

21 

11 

21 

11 

22 

12 

22 

12 

23 

13 

23 

13 

24 

14 

24 

14 

25 

15 

25 

15 

26 

16 

26 

16 

27 

17 

27 

17 

28 

18 

28 

18 

29 

19 

29 

19 

30 

63 


98 

20 

30 

100 

20 

31 

102 

21 

31 

104 

21 

32 

106 

22 

32 

108 

22 

33 

110 

23 

33 

112 

23 

34 

114 

24 

34 

116 

24 

35 

118 

25 

35 

120 

25 

36 

122 

26 

36 

124 

26 

37 

126 

27 

37 

128 

27 

38 

130 

28 

38 

132 

28 

39 

134 

29 

39 

136 

29 

40 

138 

30 

40 

140 

30 

41 

142 

31 

41 

144 

31 

42 

147 

32 

42 

148 

32 

43 

151 

33 

43 

152 

33 

44 

155 

34 

44 

156 

34 

45 

159 

rr 
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-  acceptance  not  possible 
=  rejection  not  possible 

If  there  is  no  entry  for  the  number 

of  items  sampli 

(n) ,  refer  to  the  cable 

entry  less 

than  the  actual 

number  sampled.  Sample 

Procedure : 

Sample  item-by 

item  until  criteria  are 

met  for  acceptance  or 

rejection,  or  discontinue  sampling 

at  termination 

point  =  156  with  no  decision. 
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OC  and  ASN  Curve  Points 


FRACTION  DEFECTIVE  (p) 

P (ACCEPT !p) 

ASN  (p) 

0.157 

0.997 

57 

0.174 

0.991 

56 

0.200 

0.950 

78 

0.218 

0.863 

99 

0.237 

0.683 

117 

0.243 

0.624 

119 

0.253 

0.498 

121 

0.279 

0.224 

105 

0.289 

0.151 

95 

0.300 

0.100 

85 
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